Add TI bulk actions endpoint by guan404ming · Pull Request #50443 · apache/airflow

guan404ming · 2025-05-10T18:56:15Z

Related Issue

Why

We need bulk endpoint to support mulit-selection in ui thus this PR focus on implementation of TI bulk actions api

How

implement it based on connection, pool and variable bulk endpoint
override the BulkService to pass dag_id and dag_run_id

Not sure if we should let users create TI by themselves thus I didn't implement it now. If needed, I could add it.

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

bugraoz93

Thanks for the PR! Direction looks good small suggestions :)

airflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py

guan404ming · 2025-05-25T16:15:30Z

Hi, @pierrejeambrun @bugraoz93
I think the ci error do related to my change since it works normally on main and only fails here. But I couldn't find the root cause for it in several days of trying. Do you know any possible direction or something could cause k8s test crush? I could keep doing more research and testing. Thanks in advance!

pierrejeambrun · 2025-05-26T14:10:31Z

I'm not sure, did you try rebasing a couple of times, maybe that's no directly related because the server is not starting.

guan404ming · 2025-05-27T12:06:39Z

I've tried rebase it multiple times and I've also add longer timeout and retry for the k8s check but it seems not works. Let me rebase it again. Thanks!

jason810496

Hi @guan404ming, I found a small difference, not sure does this difference related to the CI error.

It's weird that k8s test fail at ensure_resource_health("airflow-api-server") 😟

airflow-core/src/airflow/api_fastapi/core_api/routes/public/task_instances.py

airflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py

kubernetes-tests/tests/kubernetes_tests/test_base.py

guan404ming · 2025-05-29T13:47:19Z

It works, thanks @jason810496 !

guan404ming · 2025-05-29T16:40:18Z

Thanks for all reviews and suggestions.

(from https://github.com/apache/airflow/tree/python-client/3.1.0rc1) ## New Features: - Add `map_index` filter to TaskInstance API queries ([#55614](apache/airflow#55614)) - Add `has_import_errors` filter to Core API GET /dags endpoint ([#54563](apache/airflow#54563)) - Add `dag_version` filter to get_dag_runs endpoint ([#54882](apache/airflow#54882)) - Implement pattern search for event log endpoint ([#55114](apache/airflow#55114)) - Add asset-based filtering support to DAG API endpoint ([#54263](apache/airflow#54263)) - Add Greater Than and Less Than range filters to DagRuns and Task Instance list ([#54302](apache/airflow#54302)) - Add `try_number` as filter to task instances ([#54695](apache/airflow#54695)) - Add filters to Browse XComs endpoint ([#54049](apache/airflow#54049)) - Add Filtering by DAG Bundle Name and Version to API routes ([#54004](apache/airflow#54004)) - Add search filter for DAG runs by triggering user name ([#53652](apache/airflow#53652)) - Enable multi sorting (AIP-84) ([#53408](apache/airflow#53408)) - Add `run_on_latest_version` support for backfill and clear operations ([#52177](apache/airflow#52177)) - Add `run_id_pattern` search for Dag Run API ([#52437](apache/airflow#52437)) - Add tracking of triggering user to Dag runs ([#51738](apache/airflow#51738)) - Expose DAG parsing duration in the API ([#54752](apache/airflow#54752)) ## New API Endpoints: - Add Human-in-the-Loop (HITL) endpoints for approval workflows ([#52868](apache/airflow#52868), [#53373](apache/airflow#53373), [#53376](apache/airflow#53376), [#53885](apache/airflow#53885), [#53923](apache/airflow#53923), [#54308](apache/airflow#54308), [#54310](apache/airflow#54310), [#54723](apache/airflow#54723), [#54773](apache/airflow#54773), [#55019](apache/airflow#55019), [#55463](apache/airflow#55463), [#55525](apache/airflow#55525), [#55535](apache/airflow#55535), [#55603](apache/airflow#55603), [#55776](apache/airflow#55776)) - Add endpoint to watch dag run until finish ([#51920](apache/airflow#51920)) - Add TI bulk actions endpoint ([#50443](apache/airflow#50443)) - Add Keycloak Refresh Token Endpoint ([#51657](apache/airflow#51657)) ## Deprecations: - Mark `DagDetailsResponse.concurrency` as deprecated ([#55150](apache/airflow#55150)) ## Bug Fixes: - Fix dag import error modal pagination ([#55719](apache/airflow#55719))

boring-cyborg bot added area:airflow-ctl area:API Airflow's REST/HTTP API area:UI Related to UI/UX. For Frontend Developers. labels May 10, 2025

guan404ming force-pushed the bulk_ti branch 4 times, most recently from b89a043 to 4cbd650 Compare May 11, 2025 11:02

guan404ming mentioned this pull request May 11, 2025

Use pytest.param.id in connection, pool, and variable bulk tests #50455

Merged

guan404ming marked this pull request as ready for review May 11, 2025 11:41

guan404ming requested review from bbovenzi, bugraoz93, ephraimbuddy, jason810496, jscheffl, kaxil, pierrejeambrun, potiuk, rawwar, ryanahamilton and shubhamraj-git as code owners May 11, 2025 11:41

bugraoz93 reviewed May 11, 2025

View reviewed changes

guan404ming force-pushed the bulk_ti branch 2 times, most recently from f108c5e to 2a514f3 Compare May 11, 2025 16:12

raphaelauv mentioned this pull request May 11, 2025

AIP-72 | "unsafe" level #45200

Closed

2 tasks

bugraoz93 reviewed May 12, 2025

View reviewed changes

airflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Show resolved Hide resolved

guan404ming force-pushed the bulk_ti branch from 2a514f3 to f304a9c Compare May 13, 2025 11:54

bugraoz93 reviewed May 13, 2025

View reviewed changes

airflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Outdated Show resolved Hide resolved

guan404ming force-pushed the bulk_ti branch 3 times, most recently from 3302d39 to f7e49d1 Compare May 14, 2025 12:05

guan404ming force-pushed the bulk_ti branch 2 times, most recently from d98dc8d to f53d5f5 Compare May 25, 2025 13:58

guan404ming force-pushed the bulk_ti branch from f53d5f5 to 0b98fb3 Compare May 27, 2025 12:05

jason810496 reviewed May 28, 2025

View reviewed changes

airflow-core/src/airflow/api_fastapi/core_api/routes/public/task_instances.py Show resolved Hide resolved

airflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Show resolved Hide resolved

guan404ming force-pushed the bulk_ti branch 3 times, most recently from 99fd2b1 to 6431549 Compare May 29, 2025 05:27

jason810496 requested changes May 29, 2025

View reviewed changes

airflow-core/src/airflow/api_fastapi/core_api/services/public/task_instances.py Outdated Show resolved Hide resolved

kubernetes-tests/tests/kubernetes_tests/test_base.py Outdated Show resolved Hide resolved

guan404ming force-pushed the bulk_ti branch from 6431549 to 24efc49 Compare May 29, 2025 12:17

Add TI bulk actions endpoint

b36eeb9

guan404ming force-pushed the bulk_ti branch from 24efc49 to b36eeb9 Compare May 29, 2025 13:46

guan404ming marked this pull request as ready for review May 29, 2025 13:46

jason810496 approved these changes May 29, 2025

View reviewed changes

bbovenzi approved these changes May 29, 2025

View reviewed changes

bbovenzi added this to the Airflow 3.1.0 milestone May 29, 2025

bbovenzi merged commit f8e2916 into apache:main May 29, 2025
98 of 126 checks passed

guan404ming deleted the bulk_ti branch May 29, 2025 16:40

sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025

Add TI bulk actions endpoint (apache#50443)

62dcda1

This was referenced Jun 9, 2025

Refactor patch_task_instance logic #51528

Merged

Add bulk TI deletion UI #51564

Closed

jose-lehmkuhl pushed a commit to jose-lehmkuhl/airflow that referenced this pull request Jul 11, 2025

Add TI bulk actions endpoint (apache#50443)

ce16128

kaxil mentioned this pull request Oct 22, 2025

Update Python Client to 3.1.0 apache/airflow-client-python#138

Merged

itayweb mentioned this pull request Nov 9, 2025

feat: adding new feature to mark task group as success or failed #58102

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

Add TI bulk actions endpoint#50443

Add TI bulk actions endpoint#50443
bbovenzi merged 1 commit intoapache:mainfrom
guan404ming:bulk_ti

guan404ming commented May 10, 2025 •

edited

Loading

Uh oh!

bugraoz93 left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

guan404ming commented May 25, 2025

Uh oh!

pierrejeambrun commented May 26, 2025

Uh oh!

guan404ming commented May 27, 2025 •

edited

Loading

Uh oh!

jason810496 left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

guan404ming commented May 29, 2025

Uh oh!

Uh oh!

guan404ming commented May 29, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Comments

Conversation

guan404ming commented May 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Related Issue

Why

How

Uh oh!

bugraoz93 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

guan404ming commented May 25, 2025

Uh oh!

pierrejeambrun commented May 26, 2025

Uh oh!

guan404ming commented May 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jason810496 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

guan404ming commented May 29, 2025

Uh oh!

Uh oh!

guan404ming commented May 29, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

guan404ming commented May 10, 2025 •

edited

Loading

guan404ming commented May 27, 2025 •

edited

Loading